Infinity Sciences 



International Journal of Engineering Issues 
Vol. 2015, no. 2, pp. 45-51 
ISSN: 2458-651X 
Copyright © Infinity Sciences 



Automated Chess Playing with a Robot 

Manipulator 

Dimitrija Angelkov, Natasa Koceska, Saso Koceski 

Faculty of Computer Science, University Goce Delcev - Stip, Stip, Macedonia 
Email: saso.koceski@ugd.edu.mk. 



Abstract- This paper describes a system for automated chess playing with a robot manipulator. Customized chess 
engine is used to implement chess rules, to evaluate the board position during the game and to compute the next 
move of the robot using the alpha-beta search algorithm. This work contributes to the recent trends for creating 
automated robotic games and introduction of non-standard human-computer interfaces. 
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I. INTRODUCTION 

Board games have been very popular since ancient times and have been played in all cultures and societies. 
Main characteristic of all board games is that they are based on movement of various objects over a specifically 
designed board according to pre-deftned set of rules. Most of the popular board games in the history are a sort of 
adaptation of a real battle between armies. Even contemporary board games are implementing the logic of defeating 
the opponent. 

Learning curve strongly depends on the type of game and the complexity of its rules. Flowever, some of the 
board games simple set of rules but, in order to master the game the player must develop profound strategies. One of 
these games is the chess game. Chess is a popular game among all ages, from young children to elderly adults. It is a 
game that exercise the brain and develops mental abilities as concentration, critical thinking, abstract reasoning, 
problem solving, pattern recognition, strategic planning, creativity etc. [1-6]. Playing chess includes various phases 
such as: perception of the board and game pieces, perception of the opponent, reasoning about the game state, and 
manipulation of the physical pieces while coordinating with the opponent. 

Chess is a two-player board game played on a chessboard, a checkered game board with 64 squares arranged in 
an eight-by-eight grid. The two opponents can be human, or human and robot (computer). Advanced computer 
technology allows creating a computer games that mimic the human behavior. Such games are traditionally played 
with input devices like keyboard and mouse. Nowadays other means of interaction have been investigated that let 
user to focus on content rather than on input device [7-11]. 

Variety of chess automata developed through the history advocate that the robotic chess game could be very 
interesting from entertainment perspective. Flistorically, the Turk, was probably the first mechanical device aimed at 
chess playing automation. It was presented in the eighties of the eighteen century, as a clockwork machine that 
played chess. Although the real working mechanism is still not clear because the original Turk machine has being 
destroyed in a fire, according to various written reports from that times, one can conclude that it was not autonomous 
at all. The Turk used magnetically instrumented chess pieces that enabled the operator to sense the game state via the 
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motion of corresponding magnets in the operator’s compartment. Thus the mechanical Turk was actually a chess 
teleoperation system, not a chess automaton [12], [13]. 

Recently various robots that enable chess automation have been presented in the literature. Chess playing robot 
arms were shown in 2010 at the Maker Faire [15], and at several press events in Russia [14]. They used instrumented 
chess sets such as the Digital Game Technology Sensory Chess Board [16] to eliminate the perception problem. A 
commercial product called the Novag 2 Chess Computer [17] includes a robot arm that can play against a person. 
However, it uses a special instrumented board for perception and special chess pieces that are co -designed with the 
manipulator. 

In this paper we present a low cost automated chess game played with a robot arm manipulator. It can play with 
chess pieces with an arbitrary form and on a variety chess boards. The proposed system uses a computer vision 
system to continuously monitor the chess board and track the movements on the board. 

H. SYSTEM DESCRIPTION 

Hardware configuration of the system consists of a chess board and pieces, a robot arm to move those pieces, a 
vision sensor to view the game board, and a personal computer. The robot arm has 6-DoF with a parallel jaw gripper 
and six servos for movement of the joints. The schematic model of the robot manipulator is presented in Figure 1. 




Figure 1. Schematic model of the robot manipulator 

Dimensions of the links (between two consecutive connection points) are given in Table 1. 

Table 1. Dimensions of the links 



Link ID 


Length (cm) 


b_s 


12 


s_el 


10 


el_e2 


10 


e2_e3 


12 


e3_e4 


12 


e4 w 


6 







In our case we have to deal with the problem of inverse kinematics i.e. knowing the position and the orientation 
the end effector need to have (in order to pick up the chess piece) calculate the set of joint values to achieve this 
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configuration. Generally we can define the problem of inverse kinematics as follows: Given a 4x4 homogenous 
transformation H, which represents the desired position and orientation of the end- effector 



H = 



R 

0 



o 



2 3 ) 



( 1 ) 



with RE SO(3) our task is to find (one or all) solutions of the equation: 

T°(.qi,q 2 ,-,qn) = H (2) 

Where r„° (q l , q 2 q„ ) = A x (q { ) • • ■ -A n ( q„ ) and q,,..., q n are the values for the joint variables that fulfill the 
previous equation. 

The robot manipulator control algorithm is running on a PC which also runs the chess engine that plans the 
game moves. The real world image of the system configuration is given in Figure 2. 




Figure 2. Real world image of the developed system 



The idea behind the overall control algorithm is the following: the game starts with the player’s move. The 
camera mounted on the top and connected via a standard USB port to a PC, capture the movement. Then the motion 
detection algorithm based on Canny edge-detection is used in order to detect the moves of the chessboard piece and 
to interpret the current positions of pieces on the chess board. The GUI of the developed application is shown in 
Figure 3. 




Figure 3. GUI of the developed application 
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III. DESCRIPTION OF THE VISION ALGORITHM 

The main input into the algorithm is provided by the web cam which is placed orthogonally to the chess board. 
It captures color images with resolution 640x480 pixels. The first problem with the captured images is that their 
brightness and contrast is depending on the environmental conditions. This issue is important because in the 
following steps consecutive frames should be compared to each other. In order to cope with this issue several 
solutions are possible such as: output transform (gamma curve), grayscale conversion or histogram equalization. In 
our case we have applied the grayscale conversion of the image. Afterwards algorithm foresees spatial 
transformations in order to correct the image distortion. In the next phase board segmentation is performed and 
afterwards, chess move detection algorithm is applied. In order to find out the direction of chess move the current 
frame is compared with the previous one without chess piece on it. Using edge detection, and a low threshold, it is 
very easy to locate the pieces and empty squares as shown on Figure 4. 




Figure 4. Edge detection and thresholding algorithm 



IV. IMPLEMENTATION OF THE GAME LOGIC 

Chess video game is implemented using existing chess engine. Chessboard is represented as an array with 64 
elements. The movements of the pieces have to follow chess rules, such as “king can move one field in each 
direction” or “knight can move like L”. 

The evaluation of the position is done based on the structure of the pawns and the occupation of the center. 
Computer generates moves that form a tree to a certain depth and searches for the best move. A common algorithm 
that is used for calculation of the best move is mini-max. In this algorithm each player tries to maximize his 
advantage and to minimize the advantage of the opponent. 

To reduce the calculations during the search, alpha -beta pruning is used (Algorithm 1). The idea is to explore 
only useful variations, by fixing on each node a maximum or minimum evaluation. Those are computed by using the 
evaluations that have already been computed. In our case a search depth is set to a level 2, to speed up the calculation 
of the next move as an important characteristic of the interactive video games. At each step of the searching the 
function retains the best score it has found so far. When the maximizing player is searching a node and finds a path 
from that node having a higher score than the minimizing player’s best score, then he knows that the node from 
which he is currently searching is too good to be true since the minimizing player will never give him the 
opportunity to play the move to that node. 
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Algorithm 1 : Alpha-beta search algorithm 

function alpha_beta_search(real_side, search_depth, alpha, beta) 

{ 

var maxscore = - 10000000; // initialization of best score 

var reg3 = new ArrayQ; 

var catch _piece = null; 
var score _to_move; 
var moves Jo j>c; 
var i = 0; 
while (i < 8) 

{ 

var regl = 0; 

while ( regl < 8) { 

if ((chessBoard[i] [ regl] & 1) == side && chessBoard[i] [ regl] !- VOID)] 

reg3 = reg3. concat (moves Jo jalculate (i, regl, side)); //concatenation of all moves 

} 

++ regl; 

} 

++i; 

} 

var i = 0; 

while (i < reg3. length)] 

catch jtiece = moving this] reg3[i], side); 

if (depth == 0){ 

score Jo jnove = side == SIDE COMPUTER ? pc_score : player score; 

} 

else] 

score Jo jnove = 0 - alpha _beta_search(getOpponent(side), depth - 1, -1 * beta, -1 * alpha); 
// recursion of alpha _beta_search function 
} 

unmovingjh is ( reg3[ i],side, catch jiece); 

if (score Jo jnove > maxscore) maxscore = score Jo jnove; 
if (max score > alpha) alpha = max score; 
if (alpha >= beta) return alpha; 

+ +i; 

} 

return max score; 

} 



V. EVALUATION 

In order to evaluate our system 10 test games were perform with a robot arm manipulator on one side and 
human on the other side. We analyzed problems encountered with perception, manipulation, and logic during these 
test games. 

We have tracked how many success manipulation as well as failures occurred. For a failure manipulation the 
following cases we taken into account: failing to grasp a piece, dropping a piece, or failure to place a piece legally. 
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For a perception following cases were taken into account: failing to find a piece on the board (e.g., due to occlusion) 
or failing to detect illegal piece placement. 

Results from the tests demonstrate the reliability of the proposed solution. Around 97% of all manipulations 
were successful, and only 3% were failures. Respect to perception errors only 1% failures occur during all the tests 
games. Logic errors (referring to failures to correctly identify an opponent's illegal moves) were not identified. 

VI. CONCLUSION 

This paper present a low cost automated chess game played with a robot arm manipulator. The proposed 
system uses a computer vision system to continuously monitor the chess board and track the movements on the 
board. The implemented motion controlled interface is able to recognize user’s hand movements in front of the web 
camera and to move the selected piece according to that movement. The predetermined set of actions that the player 
can perform following the chess rules enables simple classification of the performed actions and interpretations of 
the movements. Customized chess engine is used to implement chess rules, to evaluate the board position during the 
game and to compute the next move of the robot using the alpha-beta search algorithm. This work contributes to the 
recent trend for creating games controlled by motion detection instead of standard computer input devices. 

The tests show that the proposed system is highly reliable and robust. Because most of the errors encountered 
were manipulation errors, in a future we plan to improve the computer vision system by using some more 
information during the image processing phase. 
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